Sr  298  MASTER  COPY  KEEP  THIS  COPY  FOR  REPRODUCTION  PURPOSES 


REPORT  DOCUMENTATION  PAGE 

Form  Approved 

OMB  NO.  0704-0188 

-  joiie  rioonmq  oura.n  -or  m..  co.i~t.on  o,  ,n.orm..K>n  «  .»<•*« *0  to  av«t q,  1  nour  oor  S?*' 

1  AGENCY  USE  ONLY  t Leave  oianti  2.  REPORT  DATE  3.  REPORT  TYPE  AND  DATEs  COVERED 

4  . .« uE  mND  SUBTITLE  ^  Note  on  the  Asymptotic  Behavior  of  the  LSE’j 
of  the  Parameters  for  Superimposed  Exponential  Signals  in 
Presence  of  Stationary  Noise 

5.  FUNDING  NUMBERS 

3 

DAAH04-96-1-0082 

6.  AuTHORi Si 

D.  Kundu  and  R.D.  Gupta 

7  PERFORMING  ORGANIZATION  NAMES(S)  AND  ADDRESS(ES) 

Center  for  Multivariate  Analysis 

417  Thomas  Building 

Department  of  Statistics 

Penn  State  University 

8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 

99-06 

9  £=o'nSCRINGY  MONITORING  AGENCY  MAMEiS.  AND  ADDRESStESI 

t  \S.  Armv  Research  Office 

P  O  Box  P21 1 

Research  Triangle  Park,  NC  27709-221 1 

10  SPONSORING  /MONITORING 
AGENCY  REPORT  NUMBER 

ft &>3ss/s.  i-a-i** 

1 1 .  SUPPLEMENTARY  NOTES 

The  views,  opinions  and/or  findings  contained  in  this  report  are  those  of  the  author(s)  “d  s^°u,d  n^be  consti rue  a 
an  official  Department  of  the  Army  position,  policy  or  decision,  unless  so  designated  by  other  documentation. 

12a.  DISTRIBUTION/  AVAILABILITY  STATEMENT 

Approved  for  public  release:  distribution  unlimited. 

12  b.  DISTRIBUTION  CODE 

13.  Aar~*—  “ 

ABSTRACT:  Superimposed  exponential  signals  play  an  important  role  in  Statistical  Signal 
Processing  and  Time  series  analysis.  In  this  note,  the  asymptotic  behavior  of  the  least 
squares  estimators  of  the  parameters  are  obtained  in  presence  of  stationary  noise  for  the 
undamped  exponential  model.  It  is  well  known  that  this  model  does  not  satisfy  the  sufficient 
conditions  of  Jennrich  (1969),  Wu  (1981)  or  Kundu  (1991)  for  the  least  squares  estimators 
to  be  consistent  even  when  the  errors  are  independent  and  identically  distributed  random 
variables  with  mean  zero  and  finite  variance.  This  paper  extends  some  of  the  earlier  works 
of  Hannan  (1971,  1973),  Walker  (1971),  Bai  et  al.  (1991),  Rao  and  Zhao  (1993),  Kundu 
(1995)  and  Kundu  and  Mitra  (1995,  1998)  in  different  ways.  Some  numerical  experiments 
are  performed  to  observe  the  small  sample  behavior  of  the  least  squares  estimators. 


14  subject  , cRMS  ^SymptotiC  covariance,  exponential  signals,  stationar 

15.  NUMBER  IF  PAGES 

noise,  complex  normal 

distribution,  least  squares  estimators. 

16.  PRICE  CODE 

17  SECURITY  CLASSIFICATION 
SR  REPORT 

UNCLASSIFIED 

18.  SECURITY  CLASSIFICATION 
OF  THIS  PAGE 

UNCLASSIFIED 

19.  SECURITY  CLASSIFICATION 
OF  ABSTRACT 

UNCLASSIFIED 

20.  LIMITATION  OF  ABSTRAC 

UL 

MSN  7540-01-280-5500 

Presented  oy  ANSI  Std.  239-18 

598-102 

A  NOTE  ON  THE  ASYMPTOTIC  BEHAVIOR  OF 
THE  LSE’S  OF  THE  PARAMETERS  FOR 
SUPERIMPOSED  EXPONENTIAL  SIGNALS  IN 
PRESENCE  OF  STATIONARY  NOISE 


D.  Kundu  and  R.D.  Gupta 

Technical  Report  99-06 


May  1999 


Center  for  Multivariate  Analysis 
417  Thomas  Building 
Penn  State  University 
University  Park,  PA  16802 


Research  work  of  authors  was  partially  supported  by  the  Army  Research  Office 
under  Grant  DAAH04-96-1-0082.  The  United  States  Government  is  authorized  to 
reproduce  and  distribute  reprints  for  governmental  purposes  notwithstanding  any 
copyright  notation  hereon. 


19990616  0/0 


dtic  QUALITY  INSPECTED  4 


A  NOTE  ON  THE  ASYMPTOTIC  BEHAVIOR  OF 
THE  LSE’S  OF  THE  PARAMETERS  FOR 
SUPERIMPOSED  EXPONENTIAL  SIGNALS  IN 
PRESENCE  OF  STATIONARY  NOISE 


Debasis  Kundu1 
Rameshwar  D.  Gupta2 


ABSTRACT:  Superimposed  exponential  signals  play  an  important  role  in  Statistical  Signal 
Processing  and  Time  series  analysis.  In  this  note,  the  asymptotic  behavior  of  the  least 
squares  estimators  of  the  parameters  are  obtained  in  presence  of  stationary  noise  for  the 
undamped  exponential  model.  It  is  well  known  that  this  model  does  not  satisfy  the  sufficient 
conditions  of  Jennrich  (1969),  Wu  (1981)  or  Kundu  (1991)  for  the  least  squares  estimators 
to  be  consistent  even  when  the  errors  are  independent  and  identically  distributed  random 
variables  with  mean  zero  and  finite  variance.  This  paper  extends  some  of  the  earlier  works 
of  Hannan  (1971,  1973),  Walker  (1971),  Bai  et  al  (1991),  Rao  and  Zhao  (1993),  Kundu 
(1995)  and  Kundu  and  Mitra  (1995,  1998)  in  different  ways.  Some  numerical  experiments 
are  performed  to  observe  the  small  sample  behavior  of  the  least  squares  estimators. 


AMS  Subject  Classification:  62J02, 62F10, 62F12 

Key  words:  Asymptotic  covariance,  exponential  signals,  stationary  noise,  complex  normal 
distribution,  least  squares  estimators. 

Short  Running  Title:  Estimating  exponential  signals. 

Corresponding  Author:  Debasis  Kundu 


1  Department  of  Mathematics,  Indian  Institute  of  Technology  Kanpur,  Pin  208016,  India. 
The  author  is  currently  visiting  as  a  visiting  associate  professor,  Department  of  Statistics, 
The  Pennsylvania  State  University,  University  Park,  PA  16802-2111. 

2  Department  of  Math.,  Stat.  and  Comp.  Sc.,  The  University  of  New  Brunswick,  Saint  John, 
PO.  Box.  5050,  Canada,  E2L  4L5.  Part  of  the  work  has  been  supported  by  the  Natural 
Sciences  and  Engineering  Research  Council  of  Canada,  Grant  No.OGP-0004850. 


1 


1.  INTRODUCTION: 


We  consider  the  following  model  of  multiple  superimposed  exponential  signals  in  presence 
of  stationary  noise; 

M 

Y(t )  =  aje*1*4  +  X(t);  for  t  =  l,...,N.  (1) 

1 

Here  a0, . . . ,  a°M  are  unknown  complex  numbers  known  as  amplitudes  and  all  of  them  are 
different  from  zero,  i  =  The  are  unknown  frequencies  lying  between  0  and 

2t r  and  they  are  distinct.  X{t)'s  are  stationary  processes  with  mean  zero  and  they  satisfy 
Assumption  1  as  given  at  the  end  of  this  section.  M  is  assumed  to  be  known.  Given  a 
sample  of  size  N,  the  problem  is  to  estimate  the  unknown  parameters  a’s  and  u’s  and  some 
times  the  error  variance. 

This  is  a  very  important  and  well  discussed  model  in  Statistical  Signal  processing.  For 
example,  in  electromagnetic  pulse  (EMP)  situations  (Ricketts  et  al.,'  1976  and  Sircar,  1987), 
the  EMP  pickup  can  be  characterized  by  a  sum  of  complex  exponentials  whose  parameters 
are  to  be  determined.  The  parameters  are  a  means  of  coding  the  various  pulse  wave  forms 
and  the  signal  approximation  thus  obtained  can  be  readily  employed  to  analyze  responses 
in  various  subsystems  under  EMP  environment.  In  system  identification  problems,  the 
characterization  of  the  impulse  responses  of  a  linear  system  by  a  sum  of  complex  exponentials 
and  then  identifying  or  approximating  the  complex  amplitudes  and  natural  frequencies  with 
high  degree  of -accuracy  has  it’s  special  importance  in  a  wide  variety  of  applications. 

Quite  a  number  of  papers  appeared  dealing  with  the  estimation  of  the  parameters  for 
this  model  particularly  when  the  X(t)’s  are  independent  and  identically  distributed  (i.i.d.) 
random  variables.  See  for  example  the  review  articles  of  Rao  (1988),  Prasad  et  al.  (1995) 
and  also  the  paper  of  Stoica  (1993)  for  an  extensive  list  of  references.  Few  articles  appeared 
in  the  last  few  years  developing  the  theoretical  properties  of  the  least  squares  estimators,  like 
Bai  et  al.  (1991),  Rao  and  Zhao  (1993),  Kundu  (1995),  Kundu  and  Mitra  (1995,  1998).  Pillai 
(1989)  pointed  out  that  although  the  assumptions  of  the  i.i.d.  errors  are  quite  common,  but 
in  many  situations  the  noise  might  be  correlated.  The  problem  has  some  theoretical  interest 
also.  No  body,  at  least  not  known  to  the  authors  considered  the  theoretical  properties  of  the 
LSE’s  under  this  general  set  up. 

It  is  worth  mentioning  that  the  model  (1)  does  not  satisfy  the  standard  sufficient  con¬ 
ditions  of  Jennrich  (1969),  Wu  (1981)  or  Kundu  (1991)  for  the  LSE’s  to  be  consistent  even 
when  the  errors  are  i.i.d.  random  variables,  see  Kundu  and  Mitra  (1998)  for  details.  There¬ 
fore,  it  is  not  immediate  how  the  LSE’s  will  behave  in  this  general  set  up.  Hannan  (1971) 
and  Walker  (1971)  considered  a  similar  kind  of  model  in  the  context  of  non-linear  time  series 
regression.  They  considered  the  following  model 

Y(t)  =  Pi  +  P2Cos(tu )  +  Pzsin(tuj)  4-  X  ( t )  (2) 
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where  X(i)’s  are  i.i.d.  random  variables  with  mean  zero  and  finite  variance.  They  mentioned 
that  it  may  be  difficult  to  obtain  the  asymptotic  properties  of  the  LSE’s  directly.  Instead  of 
considering  the  LSE’s  they  make  the  Fourier  transform  of  the  data  and  obtained  the  estima¬ 
tors  of  the  frequencies  by  maximizing  the  periodogram.  They  called  them  as  approximate 
least  squares  estimators  (ALSE’s).  They  obtained  the  consistency  and  the  asymptotic  nor¬ 
mality  property  of  the  ALSE’s.  Hannan  (1973)  extended  the  results  of  Hannan  (1971)  and 
Walker  (1971)  to  the  case  when  X(i)’s  are  from  a  stationary  time  series  with  mean  zero  and 
finite  variance  and  has  a  continuous  spectrum.  Hannan  (1973)’s  approach  is  quite  similar  to 
that  of  Hannan  (1971)  or  Walker  (1973). 

Bai  et  al.  (1991)  first  proved  directly  the  consistency  of  the  LSE’s  of  the  parameters  under 
the  assumptions  that  X(f)’s  are  i.i.d.  normal  random  variables  with  mean  zero  and  finite 
variance  Rao  and  Zhao  (1993)  obtained  the  asymptotic  distribution  of  the  LSE’s  under 
the  same  assumption  as  that  of  Bai  et  al.  (1991).  Kundu  (1995)  obtained  the  consistency 
of  the  LSE’s  when  the  errors  are  i.i.d  random  variables  with  mean  zero  and  finite  variance, 
but  under  some  restrictions  on  the  parameter  space.  Kundu  and  Mitra  (1995)  obtained  the 
strong  consistency  of  the  LSE’s  under  the  i.i.d.  assumptions  of  the  error  random  variables 
and  very  recently  Kundu  and  Mitra  (1998)  obtained  the  asymptotic  distribution  of  the 
LSE’s  under  the  same  assumption  as  that  of  Kundu  and  Mitra  (1995).  In  this  paper  we  try 
to  generalize  the  result  when  the  errors  are  from  a  stationary  sequence.  Our  approach  here 
is  quite  different  from  Hannan  (1971,  1973),  Walker  (1971),  Bai  et  al.  (1991),  Rao  and  Zhao 
(1993)  and  Kundu  (1995).  We  make  the  following  assumptions  on  X{t). 

Assumption  1:  X(t)  is  a  complex  valued  stationary  process  and  X(t)  =  U(t)  +  iV(t).  Here 

OO  00 

U(t)  =  £  a(j)c(t  -  j)  v«=  EWM‘-i)  <3) 

j  =  — OO  j  —  —  0 © 

where  e(t)’s  and  e(i)’s  are  i.i.d.  real  valued  random  variables  with  mean  zero  and  finite 
variance  <72.  Also  e(i)’ s  and  e(t) ’  are  independent  of  each  other  and  Ej=-oo  I® O')  I  ^  00 > 

££-00  W)\<°°- 

We  denote  Var(X(t))  =  a2  (  E£_oo  l«OOI2  +  ££-«*>  W)\2)  =  72  <  oo.  The  major 
aim  of  this  paper  is  to  prove  directly  the  consistency  of  the  LSE’s  of  the  parameters  of  the 
model  (1)  under  Assumption  1,  of  the  error  random  variables.  We  also  obtain  that  the  least 
squares  estimators  are  asymptotically  normal  with  mean  vector  zero  and  certain  variance 
covariance  matrix.  The  explicit  expression  of  the  asymptotic  variance  covariance  matrix  is 
obtained,  which  it  seems  is  not  available  in  the  literature.  We  also  obtain  the  consistency 
and  the  asymptotic  properties  of  the  estimator  of  72.  This  paper  generalizes  the  works  of 
Bai  et  al.  (1991),  Rao  and  Zhao  (1993),  Kundu  (1995),  Kundu  and  Mitra  (1995,  1998).  It 
is  important  to  point  out  that  Hannan  (1971,  1973)  or  Walker  (1971)  did  not  consider  the 
exact  LSE’s  and  moreover,  Hannan  (1973)  did  not  consider  the  multiparameter  situation 
or  the  estimation  of  the  variance  of  error  random  variables.  The  exact  expression  of  the 
asymptotic  distribution  of  the  multiparameter  situation  is  not  available  in  the  literature. 
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Therefore,  our  results  extends  the  results  of  Hannan  (1971,  1973)  and  Walker  (1971)  to  the 
complex  parameter  and  also  to  the  multiparameter  situation.  In  this  paper  the  almost  sure 
convergence  means  with  respect  to  the  Lebesgue  measure  and  it  will  be  denoted  by  a.s..  The 
notation  a  =  0(Nb)  means  fa  is  bounded  for  all  N.  Also  the  real  and  imaginary  part  of  a 
complex  number,  say  a,  will  be  denoted  by  or  and  a/  respectively.  Therefore  any  complex 
number  a  can  be  written  as  a  =  a,R  +  iaj.  Np( a,  B)  denotes  the  p  variate  normal  distribution 
with  mean  vector  a  and  the  covariance  matrix  B  and  N(a,  b)  denotes  the  univariate  normal 
with  mean  a  and  variance  b. 

The  rest  of  the  paper  is  organized  as  follows.  In  Section  2,  we  prove  the  consistency  and 
asymptotic  normality  of  the  LSE’s  of  the  parameters  of  the  model  (1)  for  the  case  M  =  1. 
For  general  M,  the  result  is  established  in  Section  3.  The  asymptotic  properties  of  the 
estimator  of  72  is  obtained  in  Section  4.  Some  experimental  findings  are  discussed  in  Section 
5  and  finally  we  draw  conclusions  from  our  results  in  Section  6. 


2.  CONSISTENCY  AND  ASYMPTOTIC  NORMALITY  OF  THE  LSE’S: 

Let’s  denote  0  =  (o,  w)  be  the  LSE’s  of  0°  =  (a°,u°),  obtained  by  minimizing; 

«(<».«)  =E|K(t)-<»“f  (“) 

t= 1 

Note  that  0,  a,  d  and  Q{a,u)  depend  on  N,  but  for  brevity  we  don’t  make  it  explicit.  To 
prove  the  necessary  results  we  need  the  following  lemma. 

Lemma  1:  Let  U(t)  be  a  stationary  sequence  which  satisfies  Assumption  1,  then 

1  N 

lim  sup  —  (t)cos(tu)  =0  a.s.  (5) 

TV— >oo  OJ  JV 

Proof:  See  Appendix. 

Comments:  The  following  result  also  can  be  proved  along  the  same  line. 

1  N 

lim  sup  —Y\tLX{t)cos{tuj)  =0  a.s.  (6) 

jv-> oo  u  NL+l 

for  L  =  0, 1, 2, . . .,  and  X(t)  satisfies  Assumption  1.  Note  that  the  above  results  (5)  and  (6) 
are  true  if  the  cosine  function  is  replaced  by  sine  function. 

Using  Lemma  1  and  the  same  techniques  as  of  Theorem  1  of  Kundu  and  Mitra  (1995), 
the  following  result  can  be  established: 
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Theorem  1:  For  M  =  1,  9  is  a  strongly  consistent  estimator  of  9°. 


Now  we  will  establish  the  asymptotic  normality  property  of  the  LSE’s.  The  idea  is  quite 
similar  to  that  of  Kundu  and  Mitra  (1998).  The  major  difference  here  is  that,  the  center 
limit  theorem  for  i.i.d.  random  variables  was  used  in  Kundu  and  Mitra  (1998)  to  prove 
the  asymptotic  normality  ,  but  here  we  need  to  use  the  central  limit  theorem  for  stochastic 
processes.  The  details  will  be  explained  below.  Let’s  denote 


Q'(0)  = 


dcm  am  dm\ 

daR  ’  dai  ’  dui  ) 


(7) 


and  Q"{9)  be  the  corresponding  3x3  matrix  which  contains  the  double  derivative  of  Q(9). 
Therefore,  expanding  Q'{9)  around  6°  by  multivariate  Taylor  series,  we  have 

Q'(9 )  -  Q'{9°)  =  (9-  9°)Q"{9)  (8) 


where  6  is  a  point  line  joining  9  and  9® .  Since  Q  ( 9 )  0,  (8)  implies, 

(9-9°)  =  -Q,(9°)[Q"(9))-1  (9) 


The  main  idea  to  prove  that  ( 9  —  9°)  converges  to  a  multivariate  normal  distribution  will  be 
as  follows.  Consider  the  following  3x3  diagonal  matrix 

D  =  diag  {AH,AT5,iV-ij  (10) 


Now  write 


(, 9-9°)  =  -Q'(9°)d[dQ"(9)D ]  1 


It  can  be  easily  shown  (see  Kundu  and  Mitra;  1998)  that 

Jim  [DQ*(J)D]  =  Jim  [DQ"(0°)D]  =  E 


(11) 

(12) 


where 


E  = 


2 

0 

-oft 


E-1  = 


1  ,  3  ay 

2  '  2  |q°|2 

3°rq/ 


2  |q° 


0 

2 

rv° 

aR 


-a°i 

®R 

|i«°|2 


and  E_1  exists  if  a0  #  0  and  it  is  as  follows; 


3  a0RO‘°i 

2  |o£°|2 

1  4. 

2  '  2  |q°|2 

'o 

-3* 


(13) 


o° 
9.  -2-L 
o  i _ n  i 


h°i2 

qa- 

°|a°|2 

6 

|oe°|2 


(14) 


Using  the  Central  limit  theorem  of  stochastic  processes  (see  Fuller  1976,  page  251),  it  easily 
follows  that  Q(0°)D  tends  to  a  multivarite  (3-variate)  normal  distribution  as  given  below; 

Q'(0°)D  — »  Ns  {o,  <72cll} 
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here  c  =  E£L-oo  Pu(h)eiw°h  +  E£L-oo  pv(h)eiuJ°h,  where  pu{h)  and  pv{h )  are  the  autocor¬ 
relation  functions  of  the  stationary  process  {U{t)}  and  {V(t)}  respectively.  Therefore,  we 

have  „  o  i  v 

(i 9  -  0°)D-1  -+  iV3( 0,  cr2cE_1) 

Now  we  can  state  the  result  as  the  following  theorem: 

Theorem  2:  Under  the  conditions  of  Theorem  1, 

{N^{&r  -  a°R),N*{ai  -  oft),  N*  (to  -w0)}  -»  AT3(0,  cr2cS  *) 


where  c  and  E2  are  as  defined  before. 

Remark:  It  may  be  mentioned  that  if  we  rewrite  the  model  (1)  as  follows 

Y(t)  =  a°eia,°(t_i)  +  X(t);  for  t  =  1, . . . ,  N,  (15) 


where  t  =  then  it  can  be  shown  along  the  same  line  as  above  that 


and 


r-i 


\  0  °  ‘ 

0  I  0 
0  0  . 


(16) 


Here  aR,  d/  and  Cj  are  LSE’s  of  the  corresponding  parameters  of  the  model  (15).  Although, 
the  model  (15)  is  more  convenient  to  deal  with,  because  of  the  independence  structure  of 
the  LSE’s,  but  in  practice  the  data  may  not  be  available  in  that  form. 


3.  MULTIPARAMETER  CASE: 


In  this  section  we  extend  the  result  of  Section  2  of  the  model  (1)  for  general  M.  Let’s 
use  the  following  notations;  6M  =  (0i, . . . ,  0M),9j  =  (ajR,  aji,  u>j),  where  a,-  =  ajR  +  ioiji  for 
j  =  1, . . . ,  M.  Similarly,  9M  and  9M0  are  also  defined.  9M0  and  9M  denote  the  true  parameter 
value  and  the  LSE’s  of  the  true  parameter  value,  respectively.  We  have  the  following  results. 

Theorem  3:  If  X(t)  satisfies  Assumption  1,  then  9M  is  a  strongly  consistent  estimator  of 

qMO 

Proof:  The  proof  can  be  obtained  similarly  as  Theorem  1,  see  also  Kundu  and  Mitra  (1995). 
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To  obtain  the  asymptotic  distribution,  first  let’s  define  a  3M  x  3M  diagonal  matrix  V 

as  follows  1,3  113, 

V  =  diag{N*,N*,N*,...,N*,N*,Ni} 

Theorem  4:  Under  the  assumptions  of  Theorem  1,  {0M  -  BM0)V  converges  in  distribution 
to  a  3 M  variate  normal  distribution  with  mean  vector  0  and  the  dispersion  matrix  o  , 


where 


tf"1  = 


CiEr1  o 

0  C2S2 


0 

0 


and 


s71  = 


0 


1  + 1  v 

2  +  2RF 

_3 

2 

6w 


0 


•  •  •  cmSa/  J 


(17) 


3  QiRQ?/ 

\v0|2 


2  \^\ 


3 

6W 

1  4.  3  3 

2  +  2  R|2  ^l^l2 

6 

RF 


_3i4f 


(18) 


and  Cj  =  Ylh^-co  Pu(h)elWjh  +  YlhL-oo  Pv(h)e  2  . 

Proof;  The  proof  can  be  obtained  similarly  as  that  of  Theorem  2,  so  it  is  omitted. 


4.  CONSISTENCY  AND  ASYMPTOTIC  NORMALITY  OF  f 

In  this  section  we  obtain  the  consistency  and  the  asymptotic  properties  of  the  LSE  of 
Var(X(t))  =  72,  given  by  y2  =  Other  than  Assumption  1,  we  need  to  make  the 

following  assumptions  on  {e(t)}’s  and  {e(t)}’s, 

Assumption  2:  Both  {e(t)}’s  and  {e(t)}’s  have  finite  six  moments  and  E{e(t)4)  =  E(e(t)4)  = 
qa4.  First  prove  the  following  lemma; 

Lemma  2:  If  is  the  LSE  of  wj  for  j  =  1, . . . ,  M,  for  the  model  (1),  then  as  N  ->  00, 

N(ujj  —  cjj)  —¥  0  a.s. 

for  j  =  1, ... ,  M.  Expanding  Q{0^)  around  0^®  by  multivariate  Taylor  series  and  using  (6) 
the  result  can  be  obtained.  Note  that 

f  =  1q(^)  =  t1  +  t2  +  t3 
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where 


Ti 

T2 


=  ^T,{m2+v(t?) 


N  ^ 
JV  t= 1 

1  N 
-Y 

N ^ 


t= 1 


AT 


M 

Y  a°jRcos(u°t)  -  &jRcos(u>jt)  -  ajfsin(oJ°t)  +  aj/sin(ujjt) 


-  V 
iV^ 


4=1 


v=1 

'  M 


+ 


21 


Tz  = 


2  * 
-V 

2  N 

-y 


M 

y  a0jIcos(u°jt)  -  ajicos(ujjt )  +  oPjRsin(uqt)  -  ajRsin{ujt ) 

V=i  ; 

(M 

y  a°Rcos(u°t)  -  ajRcos(ujjt)  -  a^sin^t)  +  (X/jsm^t) 

(M 

y  ajjCos(ujjt)  -  ajicos(ihjt)  +  a°Rsin(u}jt)  -  ajRsin(u>jt) 


+ 


Observe  that  Ti  converges  to  72  a.s.,  T3  converges  to  zero  a.s.  by  Theorem  3  and  (6)  and 
T2  converges  to  zero  a.s.  can  be  established  with  the  help  of  Lemma  2  and  Theorem  3  along 
the  same  line  of  Rao  and  Zhao  (1993).  Thus  we  have  the  following  theorem. 

Theorem  5:  If  9M  is  the  LSE  of  6M0  for  the  model  (1),  with  X{t)  satisfies  Assumptions  1 
and  2,  then  -y2  is  a  strongly  consistent  estimator  of  j2 

Now  we  obtain  the  asymptotic  distribution  -y2.  First  we  need  to  consider  the  following 
lemmas. 


Lemma  3:  If  (X(t)}  is  the  sequence  of  random  variables  as  defined  in  Section  1  and  <2)j  is 
the  LSE  of  u?,  for  j  =  1, . . . ,  Af ,  of  the  model  (1),  then 


-j=YX{t)  (cos^t)  -  cosiuijtj)  0 


in  probability 


Proof:  Using  the  mean  value  theorem  on  ( cos(u>jt )  —  cos(u)jt))  and  using  Theorems  3,  4  and 
(6)  it  can  be  obtained. 


Lemma  4:  If  Cjj  and  ay  are  the  LSE’s  of  and  a°  respectively  of  the  model  (1),  then 


1 

y/N 

1 

Vn 


N 


N 


ct° |2  Y  cos2(u°t)  -  a]aj  Y  cos(J-t)cos{ujt) 


t=  1 
N 


t= 1 
N 


a°j |2  Y  cos2{&jt)  -  oPj&j  Y  cos(u^t)cos(ujt) 


t= i 


t= i 


-4  0 


in  probability 
in  probability 
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Proof:  Using  Theorem  3  and  Lemma  2  the  results  can  be  established. 

The  results  in  Lemmas  3  and  4  are  true  if  the  cosine  functions  are  replaced  by  sine 
functions. 

Lemma  5:  If  72  is  the  LSE  of  y2,  then 


v'jvjf  -I|X(()f}->0 


in  probability 


Proof:  Consider 

y/Nf  =  VNTx  +  VNT2  +  VNTz  =  Gi  +  G2  +  G3  (say) 

Expanding  G2  and  using  Lemma  4  it  follows  that  G2  converges  to  zero  in  probability.  Using 
Lemma  3  and  Theorem  3,  it  can  be  shown  that  Gz  also  converges  to  zero.  Therefore,  the 

result  follows. 

We  also  have  the  following  lemma. 

Lemma  6:  If  U{t)  and  V(t)  satisfy  Assumptions  1  and  2,  then 

yftflf'Vttf-c2  E  a(j)2)  ->  AT  (o.  (tj  -  3)r,(0)2  -H  2  E  TiW2). 

\N  t= 1  j=-oo  )  \  j=-O0  ) 

similarly 

E  W)5)  ^w(o,(^-3)r2(o)2  +  2  E 

\N  t=  1  j=- oo  J  \  j=-°°  } 

and  they  are  independent.  Here  I\(h)  and  T2(h)  are  the  auto  covariance  functions  of  U(t) 
and  V(t)  respectively. 

Proof:  See  Fuller  (1976). 

Therefore,  we  have  the  following  result: 

Theorem  6:  Under  the  Assumptions  1  and  2 

(OO  OO  \ 

f  -  ct2(  e  MY  +  E  MY  ^ 

j~- OO  j=-oo  / 

(OO  OO  \ 

o,(r?-3)(ri(o)2  +  r2(o)2)  +  2  J2  r1{h)2  +  2  £  r2W2 

j=- 00  j=- 00  j 
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Proof:  Using  Lemmas  5  and  6,  it  follows  immediately. 

Note  that  when  both  e(t)’s  and  e(f)’s  are  normally  distributed  random  variables,  with 
ancj  y (f)  =  e(t)  for  all  t,  then  the  asymptotic  distribution  a2  as  obtained  by  Rao 
and  Zhao  (1993)  can  be  obtained  from  Theorem  5,  by  substituting  77  =  3,  Ti(0)  =  T2(0)  =  o2 
and  T\(h)  =  r2(/i)  =  0  for  all  h  ^  0 


5.  NUMERICAL  EXPERIMENTS  AND  DISCUSSIONS: 


In  this  section  we  perform  some  Monte  Carlo  simulations  to  see  how  the  asymptotic 
results  work  for  small  sample.  We  considered  the  following  model: 


Y(t)  =  2.0ei2*flt  +  3.0ei2*f2t  +  X(t);  t  =  1,...,25.  (20) 


where  h  =  .15 Hz  and  /2  =  17Hz.  X(t)  =  U(t)  +  iV(t),  U(t)  =  e(t)  +  .5 e(t  -  1)  and 
yu\  _  +  .5 e(t  —  1).  Note  that  |/i  —  /2I  <  ^  and  this  is  quite  important  from  the 

applications  point  of  view  (see  Tufts  and  Kumaresan;  1982  or  Breslar  and  Macovski;  1986). 
Here  e(t)  are  i.i.d.  random  variables  with  mean  zero  and  finite  variance,  similarly  e(t)  s 
are  also  normal  random  variables  with  mean  zero  and  finite  variance.  e(t)’s  and  e(t)’s  are 
independent.  Numerical  results  are  obtained  for  different  SNR  =  5dB,  lOdB,  15dB  and  20 

dB.  SNR  is  defined  as  signal  p0Wer 

SNR  =  10logw—. — - - 

noise  power 

where  signal  power  =  |o:i|2  +  i 1 2  and  noise  power  =  E\X(t)\  . 


All  these  computations  are  performed  at  the  Pennsylvania  State  University  ,  using  SUN 
workstation  and  using  the  IMSL  random  deviate  generators.  For  a  particular  data  set  we 
estimate  the  nonlinear  as  well  as  the  linear  parameters  by  the  least  squares  method.  We 
compute  the  average  estimates  and  the  average  mean  squared  errors  (MSE’s)over  1000  repli¬ 
cations.  The  results  can  be  obtained  directly  from  the  authors  on  request.  We  present  the 
main  findings.  From  the  results  it  is  observed  that  SNR  increases  the  MSE’s  decrease  for 
both  the  linear  and  the  nonlinear  parameters  which  indicates  the  consistency  of  the  least 
squares  estimators  of  both  the  linear  as  well  as  nonlinear  parameters.  It  is  also  clear  from 
the  results  that  the  rate  of  convergence  of  the  nonlinear  parameters  are  more  than  that  of 
the  linear  parameters.  As  SNR  increases  the  MSE  becomes  closer  to  the  asymptotic  variance 
(ASVA),  although  in  some  cases,  particularly  for  small  SNR,  it  is  observed  that  the  MSE 
is  more  than  the  ASVA.  For  the  nonlinear  parameters  MSE-ASVA  converges  to  zero  faster 
than  that  of  the  linear  parameters. 
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6.  CONCLUSIONS: 


In  this  paper  we  consider  the  one  parameter  and  multiparameter  superimposed  expo¬ 
nential  signal  model  under  the  assumption  of  additive  stationary  noise.  We  obtain  the 
asymptotic  properties  of  the  least  squares  estimators  directly  which  generalizes  some  of  the 
existing  results.  We  also  obtain  the  explicit  expression  of  the  covariance  matrix  for  the  mul¬ 
tiparameter  case,  which  it  seems  is  not  available  in  the  literature.  We  prove  the  consistency 
and  the  asymptotic  normality  of  the  estimator  of  the  error  variance  in  this  general  set  up. 
From  the  numerical  studies  it  is  observed  that  the  finite  sample  inference  can  be  drawn 
from  the  asymptotic  result  for  reasonable  sample  sizes  for  both  the  linear  and  nonlinear 

parameters. 
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APPENDIX: 


Proof  of  Lemma  1: 


if  C >(t)cos(te)  =  E  aUHt  -  j)cos(t») 

N  1  jV  t=lj  =  -00 

=  -jrr  Y  a(j)cos(jO)Ye(t  —  i)cos((t  —  j)6») 

-W  j=-oo  t=l 

Y  ~~  j)sin((t  -  j)6) 

M  j=-oo  t= 1 


Therefore 


sup 

e 


i-£U(t)cos(t0) 

iV  t= 1 


<  sup 


+  sup 
6 


oo  N 

—  y  a{j)co8WY€(t~ j)cos((t~ M 

iV  j=-oo  t= 1 

-J-  Y  -  j)9) 

iV  j=- oo  t=i 


(21) 
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We  would  like  to  prove  that  both  the  terms  on  the  right  hand  side  of  (21)  converges  to  zero 
as  N  tends  to  infinity.  Now  observe  that 

£sup  4  X  <x{j)cos{jO)Ylz(t-3)cos((t-j)e)  ^ 

6  -N  j=_oo  t=l 

oc  N 

—  X  |a(j)l^suP  ]Oe(t-j)cos((t-j)0)  < 

N  j=-co  6  t=  1 

—5—  X  la0')l{-®suP  c(^~  +  .Esup  e(t  —  j)e  J'^|}  (22) 

i=-oo  ^ 

Also 

-L  £  |oO)|Bsup|e(«-j)ei<‘-J)*|<^f  E  |aO)||£sup|e(i-j)e‘<*-')'|2| 

j— — oo  J  00 

<  i;  l«(j)l(w+  £  i(j<(raWm  +  o))  (23) 

— oo  t  t=-N+l  \  m  /  ) 

where  the  sum  E£_*+i  omits  the  term  t  =  0  and  the  sum  Em  is  over  N  -  |i|  terms 
(dependent  on  j).  Since 

X  E  (  X  e(m)e(m  + 1)  ^  <  X  \E  X  e(m)e(m  +  t)  1  =  0(N>) 

t=— 7V+1  \  m  /  t=— AM-1  {  171  ) 

uniformly  in  j,  therefore  (23)  is  0(N~\)  and  so  (22)  is  also  O(N^).  Observe  that  if  we 
choose  any  subsequence  {Ns}  of  {N},  where  8  >  4,  then  we  can  make  (22)  to  be  summable 
over  that  subsequence,  so  let’s  choose  in  particular  the  subsequence  K  =  N5.  Therefore, 

£sup  -X  X  <x(j)cos{je)Y,e(t -  j)cos((t  -  j)0)  =  0(K  *) 

9  ^  j=— oo  t=  1 

Similarly  the  result  is  true  if  the  cosine  function  is  replaced  by  sine  function.  So  we  have 

£sup  4 X U{t)cos(tO)  =  0(K~*) 

6  E  t= l 

Therefore,  by  using  the  Chebyshev’s  inequality  we  obtain, 

1  K 

sup  —  X  U C t)cos(td )  — >  0  a.s. 

o  E  t= i 
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when  K  =  N5.  Now 


sup  sup 
e  ns<j<(n+ i)5 


i £ u(t)ws(te)  -  A  Y,u(t)cos(te) 


< 


1 


(N+i)5 

£  I^WI 

t=iV5+l 


(24) 


The  mean  squared  errors  of  the  right  hand  side  of  (24)  is  dominated  by  N  2 ,  therefore,  the 
left  hand  side  of  (24)  converges  to  zero  a.s.,  which  proves  the  lemma. 
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